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ABSTRACT 

In this paper, we consider the problem of information- 
theoretic waveform design for active sensing systems such 
as radar for extended targets. Contrary to the popular for- 
mulation of the problem in the estimation-theoretic context, 
we are rather interested in a Bayes decision theoretic ap- 
proach where a target present in the environment belongs to 
two or more classes whose priors are known. Optimal in- 
formation theory based transmit waveforms are designed by 
maximizing mutual information (MI) between the received 
signal and the target impulse response, resulting in a novel 
iterative design equation. We also derive signal to noise ratio 
(SNR) maximization based waveforms. In an effort to quan- 
tize the benefits of such a design approach, the delay-Doppler 
ambiguity function of information-theoretic waveforms are 
presented and is compared with Barker codes of similar time- 
bandwidth product. It is found that the ambiguity function 
of information-theoretic waveforms has very sharp main lobe 
in general and excellent time autocorrelation properties in 
particular. 

Index Terms — Information theory, waveform design, 
mutual information, Bayes decision theory 

1. INTRODUCTION 

The use of information theory to design waveforms for radar 
systems was first investigated in Q. In that work, Bell solved 
two waveform design problems, named as optimal target de- 
tection and optimal information extraction or optimul estima- 
tion solutions. Signal to noise ratio (SNR) at the output of 
the receiver filter was maximized for the former while for the 
later, maximization of mutual information (MI) between the 
target impulse response and received signal is performed. It 
was reported that while the optimal target detection solution 
places as much energy as possible in the largest target scatter- 
ing mode, the optimal information extraction distributes the 
energy among the target scattering modes in order to max- 
imize the MI, which is referred to as the waterfilling solu- 
tion. MI and SNR or minimum mean squared error (MMSE) 



based designs are probably the two most popular approaches 
to solve the waveform design problem as reported in the lit- 
erature, with the former not being as well studied as the later. 
Even lesser attention has been given to quantify the benefits 
of MI based designs. 

Yang and Blum Q extended the work by Bell and in- 
vestigated the design of MIMO radar waveforms using 
information-theoretic and estimation-theoretic approach. 
Apart from studying the optimal waveform design prob- 
lem for estimating extended target's parameters, the authors 
looked at any possible equivalence that may exist between 
the information-theoretic and estimation-theoretic approach. 
They conclude that under total power constraints, the wave- 
form that maximizes the MI also minimizes the MMSE. The 
optimal solution also employs the waterfilling, so the trans- 
mitted power is allocated to frequency bins where stronger 
target scattering is expected. A relation that is developed in 
between the MMSE and MI is proved in the paper in the 
radar waveform design context as well. In Q, Leshem et 
ah extend the water filling approach to multiple extended 
targets. The authors are primarily interested in MI maxi- 
mization solution for multiple extended targets under total 
power constraint. Waveforms are designed for simultane- 
ously estimating and tracking parameters of multiple targets 
using insights from multiuser information theory. The work 
in Q is considered and expanded to solve the problem of 
waveform design for multiple targets using information the- 
ory. We would note that both works did not consider Bayes 
context while formulating their respective problems. 

In Goodman et al. |6], adaptive waveform design for tar- 
get recognition problem is studied. Waveform design is in- 
tegrated with sequential hypothesis testing (SHT) framework 
in bayes context. Under SHT, a decision is made to select a 
hypothesis after each observation, or to make another obser- 
vation if a hypothesis cannot be selected with sufficient con- 
fidence. It is pointed out that while exact formulation of SNR 
maximizing waveform design and MI maximizing waveform 
design is not presented under Bayes context, they are still in- 
tuitively satisfying. Sowelam and Tewfik addressed the in- 



formation theoretic based waveform design problem in (7) in 
target classification context for two cases. Kullback Leibler 
information (KLI), which measures the dissimilarity between 
the observed target and the alternative targets, is used as ob- 
jective function for adaptive waveform design. Unfortunately, 
the results of (7) are not easily extended to the M-class prob- 
lem when M > 2. MI and KLIN were also used for waveform 
design in 0. 

Briles |4 ] studied the related problem of target identifi- 
cation using Rate-Distortion theory and was able to derive 
bounds on error probability and mutual information by mod- 
eling the target identification problem as a communication 
systems problem. The performance bounds were derived by 
defining a new Bayes rate-distortion function where a target 
may belong to any one of M target classes. 

Our primary objective in this work is to study the follow- 
ing question: What does mutual information maximization 
buy us in radar target classification? While few works such 
as El, (H have addressed the problem in radar context and 
in a more general setting, they were either not interested 
in Bayes classification context and/or the efforts were largely 
concentrated on analyzing MMSE or error probability perfor- 
mance of MI based designs. We are rather interested in ad- 
dressing the question posed earlier by investigating the delay - 
Doppler resolution performance of such a design. There are 
two contributions of this work: first, we formulate and solve 
MI maximizing waveform design problem in Bayes context, 
which has not been solved before to the best of our knowl- 
edge. An iterative design algorithm is proposed and proved 
which solves the MI maximization problem. Secondly, we 
study the delay-Doppler resolution characteristics and present 
the ambiguity function of the waveforms designed. The am- 
biguity function is compared with a phase coded waveform 
such as Barker code of similar time-bandwidth product to un- 
derstand the benefits of information-theoretic design. 

The rest of the paper is as follows: the two main theo- 
rems of the paper are presented in section II and section III, 
where the first summarizes the MI based waveform design 
and the second outlines the SNR based waveform design, re- 
spectively. The delay-Doppler characteristics of the designs 
are presented in section IV where it is compared with that of 
Barker code, following which we conclude in section V. 

2. INFORMATION-THEORETIC DESIGN 

Consider a target classification problem where a target present 
in the environment may belong to one of the two target 
classes, whose prior probabilities are known. The finite ran- 
dom target impulse response of length L for each target class 
is modeled as an impulse response matrix similar to Q and 
EL denoted by Go and Gi. The elements of these matrices 
are Gaussian distributed with different means and the same 
variance. The transmitted radar signal is represented by the 
discrete waveform x. The target will spread x according to its 



target impulse response, Go and Gi. Since the target present 
may belong to any of the two classes, the received signal by 
the radar can be written, under the two hypothesis, as 



H : y = G x + n, 
Hi: y = Gix + n, 



(1) 



where the received vector is corrupted by Gaussian noise n, 
which has zero mean and covariance matrix H n = cr 2 I. The 
information theoretic radar waveform design, that maximizes 
the MI, I (y ; G |x), can be summarized in the theorem below. 

Theorem 1. Assume that x is a finite energy waveform with 
energy E x and that the target present in the environment can 
be characterized by target impulse response Go orG±. Con- 
sider the hypothesis testing problem as presented in (1). 

Then the mutual information (MI) maximization problem 
can be written as follows. 



max 



subject to 



£ap(iTi)e- F<(x ' y ' 



log J2ap(Hi)e- Fi ^ 

\i=0 

x T x < £L, 



(2) 

where i^(x,y) = (y — G i x) T (y - G i x)/2a 2 and a = 

1/ (27r<j 2 ) iV ^ 2 . The optimum transmission waveform x that 
maximizes the mutual information satisfies the following iter- 
ative equation: 



x = — 



i=0 v 7 



e -(y- Gl x)-(y-G lX )/2a 2 G . (y _ Gi x)/<J 2 . 

(3) 

Proof The mutual information between the received signal y 
and target impulse response G can be written as follows. 



7(y;G|x) = if(y|x)-if(y|G,x) 
= H (y\ X ) - H (n) . 



(4) 



So maximizing mutual information is equivalent to maximiz- 
ing entropy of y, H (y|x), which is given by 

#(y|x) 

= - / ( i p mpiym) log (tpmpiym) d y . 

y€Y \i=0 J \i=0 J 

(5) 

Maximizing the entropy is therefore equivalent to maximizing 
4>(x, y) with respect to x for each y € Y, where 



(x,y) 



£p(ffi)p(y|ffi) log Ep(#i)p(y|ffi) 

i=0 / \i=0 

E op (Hi) e~ F ^yA log f E op (Hi) e~ F ^) , 
i=o ) \i=o J 

(6) 



where a and F;(x, y) are given in Theorem 1. The optimiza- 
tion problem that maximizes the mutual information between 
the received vector and target impulse response then becomes, 



max 



subject to 



log ( X>p(fT0e~ F<(x,y) 

\i=0 



(7) 

The optimization problem can then be solved using Lagrange 
multipliers. We omit the details becausee of space limitations. 
After solving the optimization problem, we get, 

1 

£ aF'i(x, y)p (Hi) e~ Fi ^ 
l 



x T E^(x,y)p(^)e 



i=0 



(8) 

where F^(x, y) = — G^(y — G^x)/^ 2 . With the received 
vector y known, the optimul transmission waveform x that 
maximizes the mutual information is the solution of (8). It 
can be easily shown that if 



x = J]aF / ,(x,y)p(^)^ (x ' y) , 



(9) 



then (8) is satisfied. Therefore the iterative equation which 
solves the optimization problem in (7) and gives the optimal 
information-theoretic waveform x can be written as, 



x 



e -(y-G s x) r (y- Gi x)/2a 2 G . (y _ Gi x)/<7 2 . 

(10) 

This concludes the proof. □ 

The information theoretic algorithms can be interpreted 
as learning algorithms. The structure of the MI maximiz- 
ing waveform in (10) corroborates this interpretation and pro- 
vides an adaptive waveform design methodology. With the 
received signal y known, the iterative solution has the capa- 
bility of adapting and designing transmit waveforms by ac- 
counting for a change in environment. 

3. SNR BASED WAVEFORM DESIGN 

In this section, we are going to present SNR based wave- 
form design for comparison purposes. With the same system 
model as in the previous section, consider the hypothesis test- 
ing problem as presented in (1). Then the waveform design 
which maximizes the SNR, or minimize the error probability, 
can be summarized in the following theorem. 

Theorem 2. Assume that x is a finite energy waveform with 
energy E x and that the target present in the environment can 



Fig. 1. Ambiguity function of information theoretic wave- 
forms based on Theorem 1 





Fig. 2. Time autocorrelation of information theoretic wave- 
forms and Barker code 



be characterized by target impulse response Go orG\. Con- 
sider the hypothesis testing problem as presented in (1). Then 
the optimization problem which will maximize SNR, or mini- 
mize error probability can be formulated as follows: 



max x T (G -Gi) T E- 1 (G -Gi)x 



subject to 



x < £L 



(11) 



and the solution to the above optimization problem, or the 
optimal waveform which maximizes SNR is the eigenvector 
associated with the largest eigenvalue of 



(Go-GifS-^Go-Gi). 



(12) 



Proof We are going to provide a sketch of proof because of 
space limitations. Using the fact that the performance of max- 
imum likelihood detector can be maximized by maximizing 
the deflection coefficient, the optimization problem in (11) 
can be obtained. 



a ~ var(T(y)) 

(x T G T S- 1 (G -G 1 )x) 2 
_ x T G T S~ 1 Gx 
= (xWGxf 

x t g t e; 1 Gx 
= x T G T E- 1 Gx 



(13) 



where G = Go — Gi . Thi is equivalent to maximizing the dif- 
ference of means of received signal under the two hypothesis 
while minimizing the variance. Lagrange multiplier method 
can then be applied to obtain the optimal waveform. □ 
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Fig. 3. Doppler cut of information theoretic waveforms and 
Barker code (at zero delay) 

4. AMBIGUITY FUNCTION AND RESOLUTION 
CHARACTERISTICS OF INFORMATION 
THEORETIC WAVEFORMS 

In this section, we are going to discuss the ambiguity function 
and resolution characteristics of the waveforms designed in 
the previous section in the information theoretic context and 
compare them with that of phase coded sequences such as the 
Barker code. We design a 143 sample information-theoretic 
waveform using (10) for SNR of 7 dB and construct a con- 
catenated Barker code of the same size by using a 13- and 11- 
length Barker code. The information-theoretic waveforms are 
designed assuming that the target present in the environment 
has a target impulse response of length 5 which is generated 
from Gaussian distribution while both hypothesis are equally 
likely. 

Fig. 1 shows the ambiguity function of the informa- 
tion theoretic waveforms which result out of Theorem 1. 
It can be observed that the ambiguity function has a very 
sharp main lobe with low side lobes. In particular, the 
information-theoretic waveforms exhibit excellent time- 
autocorrelation properties. Since phase coded sequences 
are known to have good range performance, we compare the 
time-autocorrelation of the designed waveforms with that of 
Barker code in Figure 2. The waveforms designed have a 
narrower range main lobe compared to Barker codes, which 
on the other hand have better range side lobe performance. 
Similarly, the Doppler cut (at zero delay) is presented in Fig. 
3 where it can be seen that the main lobe of information- 
theoretic waveforms matches closely with that of Barker 
code, which however, have better side lobe performance. Al- 
though phase code sequences like Barker codes have good 
range performance, it is widely known that their performance 
degrades with non-negligible Doppler. The ambiguity func- 
tions of information-theoretic waveforms and Barker codes 
are presented in Fig. 4 and Fig. 5 where it can be seen that 
information-theoretic waveform perform extremely well for 
non-negligible Doppler, a situation where other phase coded 
sequences perform poorly. The peak side lobe for the ambi- 
guity function of information-theoretic waveforms is about 12 
dB lower than the main lobe whereas if you see Fig. 5, it can 
be observed that the peak side lobe for Barker code is about 



\ 




Fig. 4. Ambiguity function of information theoretic wave- 
forms in dB scale 




Fig. 5. Ambiguity function of Barker code in dB scale 

4.7 dB lower than the main lobe. It must be noted that we 
intend to investigate the performance of our waveform design 
with other known codes of good delay-Doppler performance 
too. Barker codes are chosen for illustrative purposes and the 
comparison serves as proof of concept here. 

5. CONCLUSIONS 

In this work, we have studied the problem of designing 
information-theoretic waveforms in Bayes context. We write 
the hypothesis testing problem by assuming that the target 
present belongs to one of two classes where the priors are 
known. We calculate the mutual information between the 
return and random target impulse response and set up an op- 
timization problem which maximizes the mutual information 
and obtain its solution. A novel iterative design algorithm 
is derived to obtain waveforms which maximize the mu- 
tual information. The information-theoretic designs have 
gained some interest in the research community in the past 
few years and this work aimed to present a design algorithm 
for such waveforms in Bayes context and study the delay- 
Doppler resolution characteristics of such waveforms. We 
compare the performance of the designed waveforms with 
that of Barker codes. It is shown that the time- autocorrelation 
of information-theoretic waveforms has a very sharp main 
lobe, while the peak side lobe is 12 dB lower than the main 
lobe, thus providing excellent performance for non-negligible 
Doppler. The Barker code, on the other hand, has the peak 
side lobe which is about 4.7 dB lower than its main lobe. This 
gives a strong case for further studying information-theoretic 
designs and establish their performance in multiple target 
scenarios. 
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